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(57) Abstract: There is disclosed an 
improved system (100) and method for 
providing a scalable dynamic objective 
metric for automatically evaluating the 
video quality of a video image. The 
system (100) comprises an objective 
metric controller (150) that is capable of 
receiving a plurality of objective metric 
model units (120, 130, 140). The system 
determines a scalable dynamic objective 
metric from a weighed average of the 
plurality of objective metric figures of 
merit. The scalable dynamic objective 
metric represents the best correlation 
of objective metric measurements of the 
video image with subjective measurements 
of the video image. The weight value 
of individual objective metric figures 
of merit may be increased or decreased 
depending upon the type of video image 
being evaluated. Individual objective 
metric figures of merit may be added 
to the system (100) or deleted from the 
system (100). The system is capable of 
continually determining a new value of the 
scalable dynamic objective metric as the 
plurality of objective metric model units 
receive new video images. 
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System and method for providing a scalable dynamic objective metric for automatic video 
quality evaluation 



The present invention is generally directed to systems and methods for 
evaluating video quality, and, in particular, to an improved system and method for providing 
a scalable dynamic objective metric for automatically evaluating video quality of a video 
image. 

5 

Video experts continually seek new algorithms and methods for improving the 
quality of video images. The primary goal is to obtain the most perceptually appealing video 
image possible. The ultimate criterion is the question "How well does the viewer like the 

1 0 resulting picture?" One way to answer the question is to have a panel of viewers watch 

certain video sequences and then record the opinions of the viewers concerning the resulting 
image quality. The results, however, will vary from panel to panel according to the variability 
between the viewing panels. This problem is commonly encountered when relying on 
subjective human opinion. The severity of the problem is increased when the viewing panel 

15 is composed of non-experts. 

Results solely based upon on human perception and subjective opinion are 
usually subjected to subsequent statistical analysis to remove ambiguities that result from the 
non-deterministic nature of subjective results. Linear and non-linear heuristic statistical 
models have been proposed to normalize these types of subjective results and obtain certain 

20 figs, of merit that represent the goodness (or the degradation) of video quality. The process of 
measuring video quality in this manner is referred to as "subjective video quality 
assessment". 

Subjective video quality assessment methods give valid indications of visible 
video artifacts. Subjective video quality assessment methods, however, are probabilistic in 
25 nature, complex, time consuming, and sometimes difficult to apply. In addition, there is a 

problem in selecting appropriate viewers for the viewing panel. A non-trained viewer will be 
a poor judge of the suitability of new video processing methods. A non-trained viewer, 
however, will likely accurately represent the general consumers in the marketplace. On the 
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other hand, a trained expert viewer will be overly biased toward detecting minor defects that 
will never be noticed by the general consumer. 

To avoid the disadvantages that attend subjective methods for evaluating video 
quality, it is desirable to use automated objective methods to evaluate video quality. 
Automated objective methods seek to obtain objective fig. of merits to quantify the goodness 
(or the degradation) of video quality. The process for obtaining one or more objective 
measures of the video quality must be automated in order to be able to quickly analyze 
differing types of video algorithms as the video algorithms sequentially appear in a video 
stream. 

Objective measures of video quality are fully deterministic. That is, the results 
will always be the same when the test is repeated (assuming the same settings are preserved). 

Because the ultimate goal is to present the viewer with the most appealing 
picture, a final judge of the value of the objective measures of video quality is the degree of 
correlation that the objective measures have with the subjective results. Statistical analysis is 
usually used to correlate the results objectively obtained (automatically generated) with the 
results subjectively obtained (from human opinion). 

There is a need in the art for improved systems and methods for automatically 
measuring video quality. The process of automatically measuring video quality is referred to 
as "objective video quality assessment". 

Several different types of algorithms have been proposed that are capable of 
providing objective video quality assessment. The algorithms are generally referred to as 
"objective video quality models". A report from the Video Quality Experts Group (V QEG) 
sets forth and describes the results of an evaluation performed on ten (10) objective video 
quality models. The report is dated December 1999 and is entitled "Final Report from the 
Video Quality Experts Group on the validation of Objective Models of Video Quality 
Assessment". The report is presently available on the World Wide Web at 
http://www.crc.ca/V PEG . 

Each different objective video quality model provides its own distinctive 
measurement of video quality referred to as an "objective metric". A "double ended" 
objective metric is one that evaluates video quality using a first original video image and a 
second processed video image. A "double ended" objective metric compares the first original 
video image to the second processed video image to evaluate video quality by determining 
changes in the original video image. A "single ended" objective metric is one that evaluates 
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video quality without referring to the original video image, A "single ended" objective metric 
applies an algorithm to a video image to evaluate its quality. 

No single objective metric has been found to be superior to all the other 
objective metrics under all conditions and for all video artifacts. Each objective metric has its 
5 own advantages and disadvantages. Objective metrics differ widely in performance (i.e., how 
well their results correlate with subjective quality assessment results), and in stability (i.e., 
how well they handle different types of video artifacts), and in complexity (i.e., how much 
computation power is needed to perform the algorithm calculations). 

A wide range of applications exist to which objective metrics may be applied. 
10 For example, fast real-time objective metrics are needed to judge the quality of a broadcast 
video signal. On the other hand, more complex and reliable objective metrics are better for 
judging the quality of non-real time video simulations. 

Using only one objective metric (and one objective video quality model) limits 
the evaluation of the quality of a video signal to the level of evaluation that is obtainable 
1 5 from the objective metric that is used. There is a need in the art for an improved system and 
method that uses more than one objective metric for video quality evaluation. 

The present invention generally comprises an improved system and method 
for providing a scalable dynamic objective metric for automatically evaluating video quality 
of a video image. 

20 In an advantageous embodiment of the present invention, the improved system 

of the invention comprises an objective metric controller that is capable of receiving a 
plurality of objective metric figs, of merit from a plurality of objective metric model units. 
The objective metric controller is capable of determining a scalable dynamic objective metric 
from the plurality of objective figs, of merit. 

25 In an advantageous embodiment of the present invention, the improved 

method of the invention comprises the steps of 1) receiving in an objective metric controller a 
plurality of objective metric figs, of merit from a plurality of objective metric model units, 
and 2) determining a scalable dynamic objective metric from the plurality of said objective 
metric figs, of merit. 

30 It is a primary object of the present invention to provide an improved system 

and method for providing a scalable dynamic objective metric for automatically evaluating 
video quality of a video image. 
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It is another object of the present invention to provide a scalable dynamic 
objective metric by obtaining a weighted average of a plurality of objective metric figs, of 
merit. 

It is an additional object of the present invention to provide a scalable dynamic 
5 objective metric by obtaining a weighted average of a plurality of objective metric figs, of 
merit using a correlation factor that represents how well an objective metric fig. of merit 
evaluates video image characteristics. 

It is another object of the present invention to continually determine new 
values of the scalable dynamic objective metric from new values of the plurality of objective 

10 metric figs, of merit as new video images are continually received. 

The foregoing has outlined rather broadly the features and technical 
advantages of the present invention so that those skilled in the art may better understand the 
detailed description of the invention that follows. Additional features and advantages of the 
invention will be described hereinafter that form the subject of the claims of the invention. 

1 5 Those skilled in the art should appreciate that they may readily use the conception and the 
specific embodiment disclosed as a basis for modifying or designing other structures for 
carrying out the same purposes of the present invention. Those skilled in the art should also 
realize that such equivalent constructions do not depart from the spirit and scope of the 
invention in its broadest form. 

20 Before undertaking the Detailed Description of the Invention, it may be 

advantageous to set forth definitions of certain words and phrases used throughout this patent 
document: the terms "include" and "comprise" and derivatives thereof, mean inclusion 
without limitation; the term "or" is inclusive, meaning "and/or"; the phrases "associated 
with" and "associated therewith", as well as derivatives thereof, may mean to include, be 

25 included within, interconnect with, contain, be contained within, connect to or with, couple to 
or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be 
bound to or with, have, have a property of, or the like; and the term "controller", "processor", 
or "apparatus" means any device, system or part thereof that controls at least one operation, 
such a device may be implemented in hardware, firmware or software, or some combination 

30 of at least two of the same. It should be noted that the functionality associated with any 
particular controller may be centralized or distributed, whether locally or remotely. 
Definitions for certain words and phrases are provided throughout this patent document, 
those of ordinary skill in the art should understand that in many, if not most instances, such 
definitions apply to prior, as well as future uses of such defined words and phrases. 
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For a more complete understanding of the present invention, and the 
advantages thereof, reference is now made to the following descriptions taken in conjunction 
5 with the accompanying drawings, wherein like numbers designate like objects, and in which: 
Fig. 1 is a block diagram that illustrates 1) a plurality of objective metric 
model units for obtaining a plurality of objective metric figs, of merit from a video stream 
and 2) a objective metric controller capable of using the plurality of objective metric figs, of 
merit to determine a scalable dynamic objective metric; and 
10 Fig. 2 is a flow chart diagram illustrating an advantageous method of operation 

of the improved system of the present invention. 



Figs. 1 and 2, discussed below, and the various embodiments set forth in this 
1 5 patent document to describe the principles of the improved system and method of the present 
invention are by way of illustration only and should not be construed in any way to limit the 
scope of the invention. Those skilled in the art will readily understand that the principles of 
the present invention may also be successfully applied in any type of device for evaluating 
video quality. 

20 Fig. 1 illustrates system 100 for providing a scalable dynamic objective metric 

for automatic video quality evaluation. System 100 receives video stream 1 10. Each of a 
plurality of objective metric model units (120, 130, ... , 140) receives a copy of the video 
signal of video stream 110. Objective metric model unit 120 applies a first objective metric 
model (referred to as "Metric 1") to obtain a first fig. of merit, f(l), that represents the quality 

25 of the video signal based on the first objective metric model. The first fig. of merit, f(l), is 
provided to controller 150. 

Similarly, objective metric model unit 130 applies a second objective metric 
model (referred to as "Metric 2") to obtain a second fig. of merit, f(2), that represents the 
quality of the video signal based on the second objective metric model. The second fig. of 

30 merit, f(2), is also provided to controller 150. Continuing in this manner, other objective 
metric model units are added until the last objective metric model unit 140 has been added. 
Objective metric model unit 140 applies the last objective metric model (referred to as 
"Metric N"). Objective metric model units (120, 130, 140) obtain a plurality of figs, of 
merit (f(l), f(2), f(N)) and provide them to controller 150. 
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The figs, of merit (f(l), f(2), f(N)) represent a series of N evaluations of the 
quality of the video stream by N different objective metrics. The figs, of merit (f(l), f(2), 
f(N)) may also be designated f(i) where the value of i goes from 1 to N. 

As will be explained below in greater detail, system 100 of the present 
5 invention provides a system and method for using the figs, of merit f(i) to calculate a scalable 
dynamic objective metric. The letter "F" (shown in Fig. 1) designates the scalable dynamic 
objective metric of the present invention. 

System 100 of the present invention comprises controller 150 and memory 
160. Controller 150 comprises a conventional microprocessor chip. Controller 150 is coupled 

10 to a plurality of objective metric model units (120, 130, ... , 140) via signal communication 
lines (shown in Fig. 1). Controller 150 operates in conjunction with an operating system (not 
shown) located within memory 160 to process data, to store data, to retrieve data and to 
output data. Controller 150 calculates scalable dynamic objective metric "F" by executing 
computer instructions stored in memory 160. 

15 Memory 160 may comprise random access memory (RAM), read only 

memory (ROM), or a combination of random access memory (RAM) and read only memory 
(ROM). In an advantageous embodiment of the present invention, memory 160 may 
comprise a non-volatile random access memory (RAM), such as flash memory. Memory 160 
may also comprise a mass storage data device, such as a hard disk drive (not shown in Fig. 1) 

20 or a compact disk read only memory (CD-ROM) (not shown in Fig. 1). 

It is noted that the system and method of the present invention may be used in 
a wide variety of types of video processing systems, including, without limitation, hard disk 
drive based television sets and hard disk drive based video recorders, such as a ReplayTV™ 
video recorder or a TiVO™ video recorder. 

25 Controller 150 and metric calculation algorithm 170 together comprise an 

objective metric controller that is capable of carrying out the present invention. Under the 
direction of computer instructions in metric calculation algorithm 170 stored within memory 
160 5 controller 150 calculates a scalable dynamic objective metric "F" using the figs, of merit 

f(0- 

30 A weighting unit 1 90 within controller 1 50 dynamically detects the currently 

occurring characteristics of the video sequence. The currently occurring characteristics may 
include such features as sharpness, color, saturation, motion, and similar types of features. 
Weighting unit 190 assigns a value (or "weight") w(i) to each objective metric (Metric 1, 
Metric 2, Metric N). For example, if Metric 1 is especially good when used on a certain 
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first type of video signal, then the value of w(l) is given a greater value than the other values 
of w(i). Conversely, if Metric 2 is not very good when used on that same first type of video 
signal, then w(2) will be given a lower value than the other values of w(i). If a second type of 
video signal is present, it may be that Metric 1 is not as good as Metric 2 when used on the 
5 second type of video signal. In that case, w(2) is given a higher value and w(l) is given a 
lower value than the other values of w(i). 

Generally speaking, the values of w(i) that weighting unit 190 selects will vary 
depending upon the type of video signal that weighing unit 190 dynamically detects. 
Controller 150 uses metric calculation algorithm 170 to calculate the sum S of the products of 
1 0 each w(i) and f(i). That is: 

S = w(l)f(l) + w(2)f(2) + ... + w(N)f(N) (1) 

or 

S-Sw(i)f(i) (2) 
where the value of i runs from 1 to N. 
15 A correlation factor r(i) is associated with each fig. of merit f(i). The 

correlation factor r(i) is obtained from the expression: 

r(i)=l-[A(i)/B] (3) 
where 

A(i) = 6S[(X(ij)-Y(ij)] 2 (4) 
20 where the value of j runs from 1 to n. 

and where 

B = n(n 2 ~l) (5) 
The values of X(ij) are the values of a set of n objective data values for a 

video image. The values of Y(iJ) are the values of a set of n subjective data values for the 
25 same video image. That is, the number of X data points (n) is the same number of Y data 

points (n). 

The value r(i) is referred to as the "Spearman rank" correlation factor. The 
value r(i) is a measure of how well the objective X values match the subjective Y values. The 
values of the correlations factors r(i) for each fig. of merit f(i) are known, having been 
30 previously determined by statistical analysis. Values of the correlation factors r(i) are stored 
in metric parameters look up table 1 80 in memory 1 50. 

A "best fitting" value for scalable dynamic objective metric "F" is desired. 
The "best fitting" value of "F" represents the highest level of correlation of the objective 
metric measurements of video quality (generated automatically) and the subjective 
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measurements of video quality (from human opinions). The "best fitting" value of "F" 
represents the closest approximation of the subjective measurements of video quality by the 
objective measurements of video quality. Because the video images in a video stream are 
constantly changing, the "best fit" will require constant automatic updating. The term 
5 "dynamic" refers to the ability of the objective metric of the present invention to continually 
change its value to take into account the continual changes of the video images in a video 
stream. 

As previously mentioned, weighting unit 190 continually (i.e., dynamically) 
detects the characteristics of the video sequence as they occur. For each correlation factor 

10 r(i), weighting unit 190 continually assigns values of w(i) to each fig. of merit f(i). To 
dynamically obtain the "best fitting" value of "F", metric calculation algorithm 170 
determines the values of w(i) that cause the value S to be a maximum for each value of r(i). 
The largest of these values (i.e., the maximum value) is selected to be the scalable dynamic 
objective metric "F". That is: 

15 F = Maximum [ S(r(l)), S(r(2)), ... , S(r(N)) ] (6) 

Scalable dynamic objective metric "F" is referred to as "scalable" because new 
objective metric model units can be easily added (as long as their correlation factors r(i) are 
defined). In addition, objective metric model units that are no longer desired can easily be 
removed. 

20 The scalable dynamic objective metric "F" of the present invention provides a 

great deal of flexibility. For example, for fast (real time) video signals, any complicated 
measurement objective metrics may be switched off so that their figs, of merit are not 
considered in the metric calculation process. For simulation and video chain optimization 
applications, where more time can be used to perform the metric calculation, the more 

25 complicated measurement objective metrics may be switched on so that their figs, of merit 
may be considered in the metric calculation process. 

The scalable dynamic objective metric of the present invention avoids the 
shortcomings of any single objective metric. This is because weighting unit 190 will assign a 
low value to w(i) for any objective metric that performs poorly in the presence of a certain set 

30 of artifacts. The scalable dynamic objective metric of the present invention achieves the 

highest correlation with the results of subjective testing when compared any single objective 
metric. The scalable dynamic objective metric of the present invention will be at least as 
good as the best single objective metric under all circumstances. Because the scalable 
dynamic objective metric permits the inclusion of any objective metric, the system and 



WO 02/49369 PCT7EP01/13817 

9 

method of the present invention is not limited to use with a particular type of objective metric 
(e.g., a "single ended" objective metric or a "double ended" objective metric). 

It is noted that the elements of the present invention that have been 
implemented in software (e.g., weighting unit 190) may be implemented in hardware if so 
5 desired. 

Fig. 2 is a flow chart diagram illustrating the method of operation of the 
system of the present invention. The steps of the method are generally denoted with reference 
numeral 200. A video image from video stream 1 10 is provided to N objective metric model 
units (120, 130, ... , 140). The N objective metric model units (120, 130, ... , 140) evaluate the 

10 video image and obtain N respective figs, of merit, f(i) (step 205). 

Weighting unit 190 in objective metric controller 150 then dynamically detects 
video characteristics of the video image and assigns N weights, w(i), to the N figs, of merit, 
f(i) (step 210). For each correlation factor, r(i), objective metric controller 150 calculates a 
sum, S(r(i)), that is equal to the sum of each product of weight, w(i), and fig. of merit, f(i) 

15 (step 215). 

Objective metric controller 150 then selects the maximum value of the sum, 
S(r(i)), that corresponds to the best correlation of objective measurements of video quality 
with subjective measurements of video quality (step 220). Objective metric controller 150 
then assigns that value to be the value of the scalable dynamic objective metric "F" (step 
20 225). Objective metric controller 150 then outputs that value of "F" (step 230). 

After the value of "F" has been output, a determination is made whether 
objective metric controller 150 is still receiving video images (decision step 235). If the video 
has ended, then the process ends. If the video has not ended and more video images are being 
received, control passes back to step 205 and the objective controller 150 continues to 
25 operate in the mariner that has been described. 

The present invention has been described as a system for providing a scalable 
dynamic objective metric for evaluating video quality of a video image. It is understood that 
the "scalable dynamic objective metric" of the present invention is a general case that 
includes as a subset the more specific case of providing a "static objective metric". To 
30 provide a "static objective metric" the present invention 1) receives a plurality of objective 
metric figs, of merit from a plurality of objective metric model units, and 2) determines a 
weight value, w(i), for each of the plurality of objective metric figs, of merit, and 3) 
thereafter keeps the weight values, w(i), constant (z.e., unchanged) during the process of 
calculating objective metric "F" for video stream 110. 
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Although the present invention has been described in detail, those skilled in 
the art should understand that they can make various changes, substitutions and alterations 
herein without departing from the spirit and scope of the invention in its broadest form. 
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CLAIMS: 



1 . A system (100) for providing a scalable dynamic objective metric (F) for 
evaluating video quality of a video image, said system (100) comprising an objective metric 
controller (150, 170, 180, 190) capable of receiving a plurality of objective metric figures of 
merit (f(l), f(2),..., f(N)) from a plurality of objective metric model units (120, 130,..., 140), 

5 and capable of determining said scalable dynamic objective metric (F) from said plurality of 
objective metric figures of merit (f(l), f(2),..., f(N)). 

2. The system (100) for providing a scalable dynamic objective metric (F) for 
evaluating video quality of a video image as claimed in Claim 1 wherein the number of said 

1 0 plurality of objective metric figures of merit (f(l), f(2),..., f(N)) may vary from two to N, 
where N is an integer number. 

3. The system (100) for providing a scalable dynamic objective metric (F) for 
evaluating video quality of a video image as claimed in Claim 1 wherein said objective 

15 metric controller (150, 170, 180, 190) is capable of determining said scalable dynamic 

objective metric (F) from a weighted average of said plurality of objective metric figures of 
merit (f(l),f(2),...,f(N)). 

4. The system (100) for providing a scalable dynamic objective metric (F) for 
20 evaluating video quality of a video image as claimed in Claim 3 wherein said objective 

metric controller (150, 170, 180, 190) comprises a weighting unit (190) that is capable of 
assigning a weight value to each of said plurality of objective metric figures of merit (f(l), 
f(2),...,f(N)). 

25 5. The system (1 00) for providing a scalable dynamic objective metric (F) for 

evaluating video quality of a video image as claimed in Claim 4 wherein said weighting unit 
(190) assigns weight values to each of said plurality of objective metric figures of merit (f(l), 
f(2),..., f(N)) by using a correlation factor, r(i), for each of said objective metric figures of 
merit (f(i)), where each correlation factor, r(i), for an objective metric figure of merit (f(i)) 
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represents how well the objective metric figure of merit (f(i)) evaluates video image 
characteristics. 

6. The system (100) for providing a scalable dynamic objective metric (F) for 
5 evaluating video quality of a video image as claimed in Claim 5 wherein said correlation 

factor, r(i), is given by: 

r(i) = l-[A(i)/B] 
where 

A(i) - 6E[(X(ij)-Y(ij)] 2 
10 where the value of j runs from 1 to n 

and B = n (n 2 - 1) 

where the values X(i j) are the values of a set of n objective data values for a 
video image and the values Y(i j) are the values of a set of n subjective data values for the 
same video image. 

15 

7. The system (100) for providing a scalable dynamic objective metric (F) for 
evaluating video quality of a video image as claimed in Claim 5 wherein said weighting unit 
(190) obtains each of said correlation factors, r(i), from a metric parameter look up table 
(180) coupled to said objective metric controller (150, 170, 180, 190), wherein said lookup 

20 table (180) contains previously recorded values of said correlation factors, r(i). 

8. The system (100) for providing a scalable dynamic objective metric (F) for 
evaluating video quality of a video image as claimed in Claim 5 wherein said objective 
metric controller (150, 170, 180, 190) is capable of calculating a plurality of sums where each 

25 sum, S(r(i)), is equal to the sum of each product of weight value, w(i), and figure of merit, 
f(i), for each of said correlation factors, r(i). 

9. The system (100) for providing a scalable dynamic objective metric (F) for 
evaluating video quality of a video image as claimed in Claim 8 wherein said objective 

30 metric controller (150, 170, 180, 190) is capable of obtaining said scalable dynamic objective 
metric (F) by selecting said scalable dynamic objective metric (F) to be the maximum value 
of the plurality of sums, S(r(i)), where said maximum value represents the best correlation of 
objective metric measurements of said video image with subjective measurements of said 
video image. 
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10. The system (100) for providing a scalable dynamic objective metric (F) for 
evaluating video quality of a video image as claimed in Claim 1 wherein said objective 
metric controller (150, 170, 180, 190) is capable of continually determining a new value of 
said scalable objective metric (F) from new values of said plurality of objective figures of 
merit (f(l), f(2),..., f(N)) as said plurality of objective metric model units (120, 130,..., 140) 
continually receive new video images. 

1 1 . The system (1 00) for providing a scalable dynamic objective metric (F) for 
evaluating video quality of a video image as claimed in Claim 1 wherein said objective 
metric controller (150, 170, 180, 190) is capable of adding at least one objective metric (f(i)) 
to said plurality of objective figures of merit(f(l), f(2),..., f(N)), and wherein said objective 
metric controller (150, 170, 180, 190) is capable of deleting at least one objective metric (f(i)) 
from said plurality of objective figures of merit (f(l), f(2),..., f(N)). 

12. The system (100) for providing a scalable dynamic objective metric (F) for 
evaluating video quality of a video image as claimed in Claim 1 wherein said objective 
metric controller (150, 170, 180, 190) comprises: 

a controller (150) capable of receiving a plurality of objective metric figures of 
merit, f(i), from a plurality of objective metric model units (120, 130,..., 140); and 

a metric calculation algorithm (170) contained within a memory (160) coupled 
to said controller (150), said metric calculation algorithm (170) containing instructions 
capable of being executed by said controller (150) to determine a value, F, for said scalable 
dynamic objective metric (F) from a weighted average of said plurality of objective metric 
figures of merit, f(i). 

13. The system (100) for providing a scalable dynamic objective metric (F) for 
evaluating video quality of a video image as claimed in Claim 12 wherein said metric 
calculation algorithm (170) contains instructions capable of being executed by said controller 
(150) to determine said value, F, for said scalable dynamic objective metric (F) according to 
the formula: 

F = Maximum [ S(r(l)), S(r(2)), ... , S(r(N)) ] 

where the values of S(r(i)) that correspond to each correlation factor, r(i), are 
determined according to the formula: 
S = Sw(i)f(i) 
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where the value of i runs from 1 to N, and where f(i) represents objective 
metric figures of merit, and w(i) represents weight values assigned to said objective metric 
figures of merit, f(i). 

5 14. The system (100) for providing a scalable dynamic objective metric (F) for 

evaluating video quality of a video image as claimed in Claim 1 comprising: 

a plurality of objective metric model units (120, 130,..., 140); 

an objective metric controller (150, 170, 180, 190) capable of receiving a 
plurality of objective metric figures of merit (f(l), f(2),..., f(N)) from said plurality of 
10 objective metric model units (120, 130,..., 140), and capable of determining a value, F, for 
said scalable dynamic objective metric (F) from a weighted average of said plurality of 
objective metric figures of merit, f(i), wherein said value F represents an objective metric that 
represents a maximum level of correlation of objective metric measurements of video quality 
and subjective measurements of video quality. 

15 

15. A system (100) for providing a static objective metric (F) for evaluating video 
quality of a video image, said system comprising an objective metric controller (150, 170, 
180, 190) capable of receiving a plurality of objective metric figures of merit (f(l), f(2),..., 
f(N)) from a plurality of objective metric model units (120, 130,..., 140); and capable of 

20 determining said static objective metric (F) from said plurality of objective metric figures of 
merit (f(l), f(2),..„ f(N)). 

16. A method for providing a scalable dynamic objective metric (F) for evaluating 
video quality of a video image comprising the steps of: 

25 - receiving in an objective metric controller (150, 170, 180, 190) a plurality of 

objective metric figures of merit (f(l), f(2),.„, f(N)) from a plurality of objective metric 
model units (120, 130,..., 140); and 

- determining said scalable dynamic objective metric (F) from said plurality of 
said objective metric figures of merit (f(l), f(2),..., f(N)). 



30 



17. The method for providing a scalable dynamic objective metric (F) for 

evaluating video quality of a video image as claimed in Claim 15 wherein the step of 
determining said scalable dynamic objective metric (F) from said plurality of said objective 
metric figures of merit (f(l), f(2),..., f(N)) comprises the step of determining said scalable 
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dynamic objective metric (F) from a weighted average of said plurality of said objective 
metric figures of merit (f(l), f(2),..., f(N))« 

18. The method for providing a scalable dynamic objective metric (F) for 
evaluating video quality of a video image as claimed in Claim 17 wherein the step of 
determining said scalable dynamic objective metric (F) from a weighted average of said 
plurality of said objective metric figures of merit (f(l), f(2),..., f(N)) comprises the steps of: 

- obtaining a correlation factor, r(i), for each of said plurality of objective 
metric figures of merit (f(l), f(2),..., f(N)) that represents how well an objective metric figure 
of merit evaluates video image characteristics; and 

- assigning a weight value to each of said plurality of said objective metric 
figures of merit (f(l), f(2),..., f(N)) using said correlation factor, r(i). 

19. The method for providing a scalable dynamic objective metric (F) for 
evaluating video quality of a video image as claimed in Claim 1 8 further comprising the steps 
of: 

- calculating a plurality of sums where each sum, S(r(i)), is equal to the sum of 
each product of weight value, w(i), and figure of merit, f(i), for each of said correlation 
factors, r(i); and 

- selecting said scalable dynamic objective metric (F) to be the maximum 
value of the plurality of sums, S(r(i)), where said maximum value represents the best 
correlation of objective metric measurements of said video image with subjective 
measurements of said video image. 

20. The method for providing a scalable dynamic objective metric (F) for 
evaluating video quality of a video image as claimed in Claim 16 further comprising the steps 
of: 

- receiving in said objective metric controller (150, 170, 180, 190) new values 
of said plurality of objective metric figures of merit (f(l), f(2),.„, f(N)) from said plurality of 
objective metric model units (120, 130,..., 140) as said plurality of objective metric model 
units (120, 130,..., 140) receive new video images; and 

- continually determining a new value of said scalable dynamic objective 
metric (F) from said new values of said plurality of objective metric figures of merit (f(l), 
f(2),...,f(N)). 
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2 1 . The method for providing a scalable dynamic objective metric (F) for 
evaluating video quality of a video image as claimed in Claim 18 further comprising the steps 
of: 

- assigning a low weight value to an objective metric (f(i)) that produces an 
undesirable objective metric figure of merit; and 

- assigning a high weight value to an objective metric (f(i)) that produces an 
desirable objective metric figure of merit. 

22. A method for providing a static objective metric (F) for evaluating video 
quality of a video image comprising the steps of: 

- receiving in an objective metric controller (150, 170, 180, 190) a plurality of 
objective metric figures of merit (f(l), f(2), . . ., f(N)) from a plurality of objective metric 
model units (120, 130, . . ., 140); 

- determining a weight value, w(i), for each of said plurality of objective 
metric figures of merit (f(l), f(2), . . f(N)); 

- keeping said weight values constant; and 

- calculating said static objective metric (F) using said constant weight values. 
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